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Abstract 

The rotor walk is a derandomized version of the random walk on 
a graph. On successive visits to any given vertex, the walker is routed 
to each of the neighboring vertices in some fixed cyclic order, rather 
than to a random sequence of neighbors. The concept generalizes nat- 
urally to countable Markov chains. Subject to general conditions, we 
prove that many natural quantities associated with the rotor walk (in- 
cluding normalized hitting frequencies, hitting times and occupation 
frequencies) concentrate around their expected values for the random 
walk. Furthermore, the concentration is stronger than that associated 
with repeated runs of the random walk; the discrepancy is at most 
C/n after n runs (for an explicit constant C), rather than c/y/n. 



1 Introduction 

Let Xq, Xi, ... be a Markov chain on a countable set V with transition proba- 
bilities p : V x V — > [0, 1] (see e.g. [20] for background). We call the elements 
of V vertices. We write P u for the law of the Markov chain started at vertex 
u (so P u -a.s. we have X = u). 
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Figure 1: Steps 0, . . . , 7 of a rotor walk associated with the simple random 
walk on a graph with 4 vertices. The thin lines represent the edges of graph, 
the circle is the particle location, and the thick arrows are the rotors. The 
rotor mechanism in this case is such that each rotor successively points to 
the vertex's neighbors in anticlockwise order. 

The rotor-router walk or rotor walk is a deterministic cellular au- 
tomaton associated with the Markov chain, defined as follows. Assume that 
all transition probabilities p(u, v) are rational (later we will address relax- 
ation of this assumption) and that for each u there are only finitely many v 
such that p(u, v) > 0. To each vertex u we associate a positive integer d{u) 
and a finite sequence of (not necessarily distinct) vertices u^ x \ . . . , u^ w '\ 
called the successors of u, in such a way that 

: u {l) = v} Tr . . 

p{u,v) = — ■ tor all it, v G V. (1) 

d(u) 

(This is clearly possible under the given assumptions; d(u) may be taken to 
be the lowest common denominator of the transition probabilities from u.) 
The set V together with the quantities d{u) and the assignments of successors 
will sometimes be called the rotor mechanism. 

A rotor configuration is a map r that assigns to each vertex v an in- 
teger r(v) G {1, . . . , d(v)}. (We think of an arrow or rotor located at each 
vertex, with the rotor at v pointing to vertex v^ v "). We let a rotor config- 
uration evolve in time, in conjunction with the position of a particle moving 
from vertex to vertex: the rotor at the current location v of the particle is 
incremented, and the particle then moves in the new rotor direction. More 
formally, given a rotor mechanism, an initial particle location xq £ V and 
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an initial rotor configuration r , the rotor walk is a sequence of vertices 
Xq,Xi,... G V (called particle locations) together with rotor configura- 
tions ro,ri, . . ., constructed inductively as follows. Given Xt and r t at time t 
we set: 



{r t {v) + 1) mod d(v), v = x t ; 
r t (v), v ^ x t 

(increment the rotor at the current particle location); and 



(ii) x t+1 := (x t )^ +1 (*t)) 

(move the particle in the new rotor direction). 

See Figure [T] for a simple illustration of the mechanism. 
Given a rotor walk, write 

n t (v) := #{s e [0,t- 1] : x s = v) 

for the number of times the particle visits vertex v before (but not including) 
time t. 

We next state general results, Theorems [THU relating basic Markov chain 
objects to their rotor walk analogues (under suitable conditions). We then 
state a more refined result (Theorem [5]) for the important special case of sim- 
ple random walk on Z 2 , followed by extensions to infinite times (Theorem [8]) 
and irrational transition probabilities (Theorem [T2"j) . We postpone discussion 
of history and background to the end of the introduction, and proofs to the 
later sections. 



1.1 Hitting probabilities 

Let T v := min{t > : X t = v} be the first hitting time of vertex v by the 
Markov chain (where min0 := oo). Fix two distinct vertices b, c and consider 
the hitting probability 

h{v) = h b)C (v) := F v {T b < T c ). (2) 

Note that h(b) = 1 and h(c) = 0. In order to connect hitting probabilities 
with rotor walks, fix a starting vertex a ^ {b, c}, and modify the transition 
probabilities from b and c so that p(b,a) = p(c,a) = 1. (Thus, after hitting 
b or c, the particle is returned to a.) Note that this modification does not 
change the function h. Modify the rotor mechanism accordingly by setting 
d{b) = d(c) = 1 and b^ 1 ' = c^ 1 ' = a. Let xq, x±, ... be a rotor walk associated 
with the modified chain. The following is our most basic result. 
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Theorem 1 (Hitting probabilities). Under the above assumptions, suppose 
that the quantity 

Ki:=l + l d(u)p(u,v)\h(u)-h(v)\ 

u£V\{b,c}, 
v€V 

is finite. Then for any rotor walk and all t, 

n t (b) + n t (c)' 

Theorem [T] implies that the proportion of times that the rotor walk hits 
b as opposed to c converges to the Markov chain hitting probability h(a), 
provided the rotor walk hits {b, c} infinitely often (we will consider cases 
where this does not hold in the later discussion on transfinite rotor walks). 
Furthermore, after n visits to {b, c}, the discrepancy in this convergence is at 
most K/n for a fixed constant K. In contrast, for the proportion of visits by 
the Markov chain itself, the discrepancy is asymptotically a random multiple 
of 1 / y/n (by the central limit theorem) . 

The condition K\ < oo holds in particular whenever V is finite, as well 
as in many cases when it is infinite; for examples see [22] . 

In the case when the Markov chain (before modification) is a simple ran- 
dom walk on an undirected graph G = (V,E) (thus, p(u, v) equals l/d(u) if 
(u, v) is an edge, and otherwise, with d(u) being the degree of u), we obtain 
the particularly simple bound K\ < 1 + J2(uv)eE ~ 

Theorem [T] can be easily adapted to give similar results for the probability 
of returning to b before hitting c when started at a = b, and for the probability 
of hitting one set of vertices before another. This can be done either by 
adapting the proof or by adding appropriate extra vertices and then appealing 
to Theorem [lj For brevity we omit such variations. 

We next discuss extensions of Theorem [1] in the following directions: hit- 
ting times and stationary distributions, an example where K\ — oo, cases 
where the particle can escape to infinity, and irrational transition probabili- 
ties. 



h(a) 



n t (b) 



n t (b) + n t (c) 
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1.2 Hitting times 



Fix a vertex b and let 

k(v) = k b (v) := E v T b (3) 

be its expected hitting time. Fix also an initial vertex a ^ b and modify 
the transition probabilities from b so that p(b, a) = 1. (Then k(a) is also the 
expected return time from b to b in the reduced chain in which the vertices 
a and b are conflated.) Let x$,Xi, ... be a rotor walk associated with the 
modified chain. 

Theorem 2 (Hitting times). Under the above assumptions, suppose that V 
is finite, and let 

K 2 ■= ma,xk(v) H — d(u)p(u, v)\k(u) — k(v) — 1|. 

v£V 2 — ' 

uev\{b}, 



Then for any rotor walk and all t, 

(k(a) + 1) 



ntib) 



< 



K> 



2 



ntib) 



Thus the average time for the rotor walk to get from a to b concentrates 
around the expected hitting time. The term corresponds to the time 

step to move from b to a. 

Note that, in contrast with Theorem [TJ, in the above result we require 
V to be finite. Leaving aside some degenerate cases, such a bound cannot 
hold when V is infinite. Indeed, if V is infinite and the Markov chain is 
irreducible, then | (k(a)+l)nt(b) — 1\ is unbounded in t, since the rotor walk has 
arbitrarily long excursions between successive visits to b; hence the conclusion 
of Theorem [2] cannot hold (for any constant K 2 ) in this case. In contrast, in 
the next result we again allow V to be infinite. 



1.3 Stationary vectors 

Suppose that the Markov chain is irreducible and recurrent, and let n : V — > 
(0, oo) be a stationary vector (so that np = n as a matrix product). Let 
Xq, Xi, ... be an associated rotor walk. Fix two vertices b ^ c and let h = hb c 
be as in (T5]) above. Also let := min{t > 1 : X t = u} denote the first 
return time to u, and define the escape probability e U)V := P U (T V < T+). 
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Theorem 3 (Occupation frequencies). For any irreducible, recurrent Markov 
chain, with the above notation, suppose that the quantity 

K 3 :=l + Ud(b) + d(c) + d(u)p(u,v)\h(u) - h(v)\ 
is finite. Then for all t, 



U,V(zV 



n t (b) n t (c) 



< 



7r(6) 7r(c) ix(b)e b)C ' 

Thus the ratio of times spent at different vertices by the rotor walk con- 
centrates around the ratio of corresponding components of the stationary 
vector. 

Now suppose that the Markov chain is irreducible and positive recurrent, 
and let ir be the stationary distribution (so that Ylvev 7T { V ) = !)• Fix a 
vertex b and let k = kj, be as in (J3J). The following result states that the 
proportion of time spent by the rotor walk at b concentrates around vr(6). 

Theorem 4 (Stationary distribution). For an irreducible positive recurrent 
Markov chain with V finite, with the above notation, let 

K4 := maxk(v) H — f— ttt + d(u)p(u,v)\k(u) — k(v) 

v£V 2 \TX[b) 

Then for all t, 

\(b) - 



,,vev 



fit (6) < K 4 7t(b) 



1.4 Logarithmic discrepancy for walks on I? 

While Theorem [1] requires the quantity K\ to be finite, experiments suggest 
that similar conclusions hold in many cases where it is infinite. We next treat 
one interesting example in which such a conclusion provably holds, but with 
an additional logarithmic factor in the bound on the discrepancy. (Additional 
such examples will appear in [22].) 

Consider simple symmetric random walk on the square lattice Z 2 . That 
is, let V = Z 2 , and let p(u, v) := 1/4 for all u,v G V with \\u — v\\i = 1 and 
p(u,v) := otherwise. Let each rotor rotate anticlockwise; that is for each 
u G V, we set d{u) := 4 and 

u« :=u + (cosf ,sinf ), i = l,...,4. (4) 
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Figure 2: The initial rotor configuration in Theorem [5j The dot shows the 
location of (0, 0). The third layer is shaded (see the later proofs). 



Consider the particular initial rotor configuration r given by 



'(0,2/)) 



| + farg(x-§,y-f) 



mod 4 



(5) 



(where arg(x, y) denotes the angle 9 G [0, 27r) such that (x, y) = r (cos 9, sin 9) 
with r > 0). See Figure El 

Fix vertices a, 6, c of Z 2 with b ^ c and modify p by setting p(b, a) = 
p(c, a) = 1. If a = 6 then also split this vertex into two vertices a and 6, let b 
inherit all the incoming transition probabilities of the original random walk, 
and let a inherit the outgoing probabilities; similarly if a = c. Also modify 
the rotor mechanism and the rotor configuration r accordingly. 

Theorem 5 (Hitting probabilities for walk on Z 2 ). Let a,b,c be vertices of 
Z 2 with b 7^ c, and consider the rotor walk associated with the random walk, 
rotor mechanism and initial rotor configuration described above, started at 
vertex a. Then for any t, with h(a) = hb tC (a) and n = n t (b) + nt{c), 



h(a) 



n t (b) 



n 



< 



C Inn 



n 



Furthermore, t < C'n 3 . Here C,C are finite constants depending on a,b,c. 

In contrast to the above result for the rotor walk, for the Markov chain 
itself, after n visits to {b, c} the proportion of visits to b differs from its limit 
h(a) by Kjyfn in expected absolute value (by the central limit theorem), 
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Figure 3: The rotor configuration after 500 visits to b, starting in the con- 
figuration of Figure |2] with a = c = (0, 0) and b = (1, 1). The rotor directions 
are: East=white, North=red, West=green, South=blue. 

while the median number of time steps needed to achieve n visits is at least 
(K') n where K > and K' > 1 are constants depending on a, b, c. (The 
latter fact is an easy consequence of the standard fact [23] that the expected 
number of visits to the origin of 1? after t steps of random walk is 0(\nt) as 
t ->■ oo.) 

Simulations suggest that a much tighter bound on the discrepancy should 
actually hold in the situation of Theorem El and in fact the results seem 
consistent with a bound of the form const /n. The rotor configurations at 
large times are very interesting; see Figure [3j (Also compare with Figure H] 
below). Further discussion of these issues will appear in [22] . 



S 



1.5 Transfinite walks 



As mentioned above, Theorem [T] implies convergence of nt(b)/(n t (b) +n t (c)) 
to h(a) only if n t (b) + rit(c) — > oo as t — > oo; we now investigate when this 
holds, and what can be done if it does not. We say that a rotor walk is 
recurrent if it visits every vertex infinitely often, and transient if it visits 
every vertex only finitely often. 

Lemma 6 (Recurrence and transience). Any rotor walk associated with an 
irreducible Markov chain is either recurrent or transient. 

Note in particular that if V is finite and p is irreducible then every rotor 
walk is recurrent. 

Fix an initial rotor configuration ro and an initial vertex xq = a. Suppose 
that the rotor walk Xq,Xi, . . . is transient. Then we can define a rotor config- 
uration r w by r^iv) := lim^oo r t (v) (the limit exists since the sequence r t (v) 
is eventually constant). Now restart the particle at a by setting x u := a, and 
define a rotor walk x u , x w +i, x w +2, ■ ■ ■ according to the usual rules. If this is 
again transient we can set r 2uj := lim^oor^+f and restart at x 2u i '■= a and so 
on. Continue in this way up to the first m for which the walk x mu] , x mu]+ i, . . . 
is recurrent, or indefinitely if it is transient for all m. Call this sequence of 
walks a transfinite rotor walk started at a. 

A transfinite time is a quantity of the form r = u 2 , or r = mu + t 
where m, t are non-negative integers. There is a natural order on transfinite 
times given by mu + 1 < m'u + 1' if and only if either m < m! or both m = m! 
and t < t', while mu + 1 < u 2 for all m and t. For a transfinite walk and a 
transfinite time r we write n T (v) = #{a < r : x a = v} for the number of 
visits to v before time r. We sometimes say that the walk goes to infinity 
just before each of the times u,2u, . . . at which it is defined. 

Lemma 7 (Transfinite recurrence and transience). For an irreducible Markov 
chain and a transfinite rotor walk started at a, for any transfinite time r, 
either n T (v) is finite for all v or n T (v) is infinite for all v. Also there exists 
Me {1,2, ... ,u} such that n Mu] {v) is infinite for all v and the rotor walk is 
defined at all r < Muj. 

Note that while it is not obvious how to use a finite computer running 
in a finite time to compute transfinite rotor walks in general, it is at least 
possible in certain settings, such as a random walk on the integers with a 
periodic initial rotor configuration. 
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Theorem 8 (Transfinite walks and hitting probabilities). Under the assump- 
tions of Theorem^ suppose further that p is irreducible, and that 



lim sup h(v) 



0. 



Then for any transfinite time r 
visited only finitely often. 



mu + t at which all vertices have been 



h(a) — 



n T (b) 



n T (b) 



m 



< 



n T (b) + n T {c) + m 



Thus the proportion of times the particle hits b as opposed to hitting c or 
going to infinity concentrates around h(a). Furthermore, Lemma [7] ensures 
that n T (b) +n r (c) + m — > oo as r — > Mu, so that the proportion converges to 
h(a). The proof of Theorem [8] may be easily adapted to cover the probability 
of hitting a single vertex b as opposed to escaping to infinity. 

Next, for a vertex b, write g{y) = gb(v) : = E^^^lL^ = b] for the 
expected total number of visits to b. Note that this is finite for an irreducible, 
transient Markov chain. 

Theorem 9 (Transfinite walks and number of visits). Consider an irre- 
ducible, transient Markov chain and fix vertices a, b. Suppose that 



lim sup g(v) 
vev 



0. 



Suppose moreover that the quantity 

K 5 := sups-0) + \ (d{b) + Y] d { u )v{u,v)\g{u) - g{v)\ 



u,v£V 



is finite. Then for any transfinite walk started at a, and for any transfinite 
time t = mu + t at which all vertices have been visited only finitely often, 



9(a) ~ 



n T (b) 



m 



< 



K R 



m 



It is natural to ask how recurrence and transience of rotor walks are 
related to recurrence and transience of the associated Markov chain. The 
following variant of an unpublished result of Oded Schramm provides an 
answer in one direction: in a certain asymptotic sense, the rotor walk is no 
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more transient than the Markov chain. For a transfinite rotor walk started 
at vertex a, let /„ be the number of times the walk goes to infinity before 
the nth return to a (i.e. I n := max{m > : n mu) {a) < n} — this is well 
defined by Lemma [7J recall that the walk is restarted at a after each escape 
to infinity). 

Theorem 10 (Transience density; Oded Schramm). Consider an irreducible 
Markov chain, and an associated transfinite rotor walk started at vertex a. 
With I n as defined above we have 

limsup — < W a (Ta = oo). 

n— >oo n 

In particular we note that for a recurrent Markov chain the right side in 
Theorem [10] is zero, so the sequence of escapes to infinity has density zero 
in the sequence of returns to a. On the other hand, for a recurrent Markov 
chain it is possible for a rotor walk to go to infinity, for example in the case 
of simple symmetric random walk on Z, with all rotors initially pointing in 
the same direction. 

Moreover, for simple random walk on Z 2 with all rotors initially in the 
same direction, the rotor walk goes to infinity infinitely many times. (To 
check this, suppose the rotors rotate anticlockwise and initially point East. 
Whenever the particle's horizontal coordinate achieves a new maximum, it 
is immediately sent directly Northwards to infinity. This happens infinitely 
often by Lemma 0) See Figure H] for a simulation of this remarkable process, 
and see [22] for further discussion. 

On the other hand, it should be noted that the rotor walk on Z 2 is re- 
current for the initial configuration in Theorem [5] (see Figure [2]). It is also 
possible for the rotor walk to be recurrent for a transient Markov chain, for 
example in the case of simple random walk on an infinite binary tree, with 
all rotors arranged so as to next send the particle towards the root. Lan- 
dau and Levine [H] studied the rotor walk on regular trees in great detail, 
in particular identifying exactly which sequences (I n ) n >o are possible on the 
binary tree. Further work on rotor walks on trees will appear in pQ. 

1.6 Stack walks 

To generalize rotor walks to Markov chains with irrational transition proba- 
bilities, we must allow the particle to be routed to a non-periodic sequence 
of vertices on its successive visits to a given vertex. 
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Figure 4: The rotor configuration after 500 restarts from a = (0, 0), for the 
transfinite rotor walk on Z 2 with all rotors initially pointing East. The rotor 
directions are: East=white, North=red, West=green, South=blue. The red 
region extends infinitely far to the North. 



Given a set V, a stack mechanism is an assignment of an infinite se- 
quence of successors u^ 2 \ . . . to each vertex u G V. The stack walk 
started at xq is a sequence of vertices xq,X\,... defined inductively by 

„ ._ „Ms t )+i) 
.— x t 

where 

n t {v) : = #{s e[Q,t-l]:x„ = v}. 

(Note that, in the case of rational transition probabilities considered previ- 
ously, the rotor walk can be regarded as a special case of a stack walk, with 
the periodic stacks given by u( fcd w+J') = u^' for 1 < j < d(u) and k > 0.) 

We illustrate the use of stacks with Theorem [12] below on hitting proba- 
bilities. The following will enable us to choose a suitable stack mechanism. 

Proposition 11 (Low-discrepancy sequence). Let pi, . . . ,p n G (0,1] satisfy 
J2iPi = 1- There exists a sequence Z\, z%, . . . G {1, . . . , n) such that for all i 
and t, 

p l t-#{s<t:z s = i} <1. (6) 
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Let p be a Markov transition kernel on V, and suppose that for each 
vertex u there are only finitely many vertices v such that p(u,v) > 0. We 
may then choose a stack mechanism according to Proposition [TTJ More 
precisely, for each vertex u, enumerate the vertices v such that p(u, v) > as 
v n , and set pi = p(u, Vi). Then let u^> ■= v z , where z is the sequence 
given by Proposition [TTJ Now let a, b, c be distinct vertices and assume that 
p(b, a) = p(c, a) = 1 and b^' = = a for all i. Write h = hb jC . 

Theorem 12 (Stack walks). Under the above assumptions, suppose that 
K 6 :=l+ \ h (u>)-h(v)\ 

ueV\{b,c},veV: 
p(u,v)>0 

is finite. For the stack mechanism described above, and any t, 

n t (b) + n t {c)' 

Proposition [TTJ can in fact be extended to the case of infinite probability 
vectors [2], and Theorem [T2l carries over straightforwardly to this case. How- 
ever, the result appears to have few applications in this broader context, since 

\ h{ u ) — h(v)\ is typically infinite when u has infinitely many successors. 

1.7 Further Remarks. 

History. The rotor-router model was introduced by Priezzhev, Dhar, Dhar 
and Krishnamurthy [21] (under the name "Eulerian walkers model") in con- 
nection with self-organized criticality. A special case was rediscovered in [9] 
in the analysis of some combinatorial games. The present article reports the 
first work on the close connection between rotor walks and Markov chains, 
originating in discussions between the two authors at a meeting in 2003. 
(Such a connection was however anticipated in the "whirling tours" theorem 
of [9], which shows that for random walk on a tree, the expected hitting time 
from one vertex to another can be computed by means of a special case of ro- 
tor walk; see also [22].) A special case of results presented here was reported 
in [13] , and earlier drafts of the current work provided partial inspiration for 
some of the recent progress in [31 [H El El [121 EL71 HH1 EE] , which we discuss 
below. 

The idea of stack walks has its roots in Wilson's approach to random 
walks via random stacks; see [2T] . 



h(a) 



n t {b) 



n t (b) + n t (c) 
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Time-dependent bounds. We have chosen to focus on upper bounds of 
the form Ki/n, where if, is a fixed constant not depending on time t. If this 
latter requirement is relaxed, our proofs may be adapted to give bounds that 
are stronger in some specific cases (at the expense of less clean formulations). 
Specifically, in each of Theorems [IH3] and [121 the claimed bound still holds if 
the relevant constant Ki is replaced with a modified quantity Ki(t) obtained 
from Ki by: 

(i) multiplying the initial additive term "1" or "maxfc(v)" or "sup g(v)" 
by the indicator l[x t 7^ Xq] (so that the term vanishes when the particle 
returns to its starting point); and 

(ii) multiplying the summand in the sum J2 UV by l[r t (tt) 7^ r (u)} (so in 
particular terms corresponding to vertices u that have not been visited 
by time t vanish). 

The same holds for Theorems [S] and in the transfinite case, but replacing t 
with r. 

The above claims follow by straightforward modifications to our proofs. 
Indeed, our proof of Theorem [5] employs a special case of this argument. 
These and other refinements will be discussed more fully in the forthcoming 
article [22]. 

Abelian property. The rotor-router model has a number of interesting 
properties that will not be used directly in most of our proofs but which are 
nonetheless relevant. In particular, it enjoys an "Abelian property" which 
allows rotor walks to be parallelized. Specifically, consider a Markov chain 
on a finite set V with one or more sinks, i.e. vertices s with p(s, s) = 1, and 
suppose that from every vertex, some sink is accessible (so that the Markov 
chain eventually enters a sink almost surely). Then we may run several rotor 
walks simultaneously as follows. Start with an initial rotor configuration, 
and some non-negative number of particles at each vertex. At each step, 
choose a particle and route it according to the usual rotor mechanism; i.e. 
increment the rotor at its current vertex and move the particle in the new 
rotor direction. Continue until all particles are at sinks. It turns out that 
the resulting configuration of particles and rotors is independent of the order 
in which we chose to route the particles. This is the Abelian property; see 
e.g. [121 Lemma 3.9] for a proof (and generalizations). 
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In the situation of Theorem [TJ for example, assume that V is finite and 
the Markov chain is irreducible, and then modify it to make vertices b and 
c sinks. Start n particles at vertex a and perform simultaneous rotor walks. 
The Abelian property implies that the number of particles eventually at b is 
the same as the number nt(b) of times that b is visited when n t (b) + n t (c) = n 
in the original set-up of Theorem [TJ and the bound of Theorem [T] therefore 
applies. 

A similar Abelian property holds for the "chip-firing" model introduced 
by Engel [TUl [TT] (later re-invented by Dhar [7] under the name "abelian 
sandpile model" as another model for self-organized criticality). The two 
models have other close connections, and in particular there is a natural 
group action involving sandpile configurations acting on rotor configurations. 
More details may be found in [12] and references therein. Engel's work was 
motivated by an analogy between Markov chains and chip-firing (indeed, he 
viewed chip- firing as an "abacus" for Markov chain calculations). 

Periodicity. In the case when V is finite, we note the following very simple 
argument which gives bounds similar to Theorems [THU but with (typically) 
much worse constants. Since there are only finitely many rotor configura- 
tions, the sequence of vertices ({x t , r t ))t>o is eventually periodic (with explicit 
upper bounds on the period and the time taken to become periodic which 
are exponentially large in the number of vertices). Therefore the proportion 
of time n t {v)/t spent at vertex v converges as t — > oo to some quantity (i(v), 
say, with a discrepancy bounded by const/t Furthermore, as a consequence 
of the rotor mechanism, we have fi(u) = J2 v &v p( u > v )^ v ) f° r an ver ti ces u 
(because after many visits to u, the particle will have been routed to each 
successor approximately equal numbers of times). Thus fi is a stationary 
distribution for the Markov chain. This implies the bound in Theorem HI ex- 
cept with a different (and typically much larger) constant in place of K^ib). 
Similar arguments yield analogues of Theorems dH31 but only in the case 
where V is finite. 

Related work. As remarked earlier, rotor walks on trees were studied in 
detail by Landau and Levine [13]. Further results on rotor walks on trees will 
appear in a forthcoming work of Angel and Holroyd [I], and further refine- 
ments and discussions of the results presented here will appear in Propp [22] . 
Cooper and Spencer [5] studied the following closely related problem. For 
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the rotor walk associated with simple symmetric random walk on Z d , start 
with n particles at the origin, or more generally distributed in any fashion 
on vertices (ii, . . . ,id) with i% + ■ ■ ■ + id even, and apply one step of the 
rotor walk to each particle; repeat this t times. (It should be noted that 
the Abelian property does not apply here — the result is not the same as 
applying t rotor steps to each particle in an arbitrary order; see [12] •) It is 
proved in [B] (see Figure 8) that the number of particles at a given vertex 
differs from the expected number of particles for n random walks by at most 
a constant (depending only on d). Further more precise estimates are proved 
in dimension d = 1 in [2] and in dimension d = 2 in [8]. 

The following rotor-based model for internal diffusion-limited aggregation 
(IDLA) was proposed by the second author, James Propp, and studied by 
Levine and Peres in [T6| ITT[ IT9] [TH] . Starting with a rotor configuration on 
Z d , perform a sequence of rotor walks starting at the origin, stopping each 
walk as soon as it reaches a vertex not occupied by a previously stopped 
particle. It is proved in [18] that, as the number of particles n increases, the 
shape of the set of occupied vertices converges to a d-dimensional Euclidean 
ball; generalizations and more accurate bounds are proved in [TT] IT9]. 

2 Proofs of basic results 

Theorems [fl-H] will all follow as special cases of Proposition ITBl below, and the 
remaining results will also follow by adapting the same proof. For any Markov 
transition kernel p and any function / : V — > K. we define the Laplacian 
Af -.V-^-Rby 



Proposition 13 (Key bound). For any rotor walk xo, xi, . . . associated with 
p, any function f and any t we have 



The proofs of Theorems [THU will proceed by applying Proposition [13] to 
a suitable /. The proof of Proposition [TBI will use the following simple fact. 



Lemma 14. IfY!i=i a i = then \ Y?i=i a i ~ Y!i=i a -i\ < \ Yn=i H f or al1 
j,k E [l,n]. 




(7) 




/(t;) + A/(u) . 
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Proof. We prove the stronger statement that | J2 i£S ai\ < ~ Yli=i kl f° r an Y 
subset S of {1, . . . ,n}\ assuming without loss of generality that ^2 iGS a i * s 
positive, it is at most £ o . :a . >0 a; = |(E i:aj >o a i ~ Ei :ai <o a i) = §££=i N- 

□ 

Proof of Proposition UM Recall that ro denotes the initial rotor configura- 
tion. For a vertex x and a rotor configuration r, consider the quantity 

$(x,r) := /(z) + E [0(tt,r(tt)) - 0(u,r o (tt))] 

where 

#«,j):= E [/(")" /(« W ) + A/(u)]. 
i=i 

Note that $>(x,r t ) is finite if r t is any rotor configuration encountered by 
the rotor walk, since the only non-zero terms in the sum over u are those 
corresponding to vertices that the walk has visited (this is the reason for 
including the term "— (j)(u, ro(it))" in the above definition). Note also that 
the definition of the Laplacian Q and the rotor property ([T|) imply for all 
u G V that 

0(u,d(u)) = O. (8) 

Let us compute the change in $ produced by a step of the rotor walk 
from (xt,r t ) to (xj+i, rj+i). The only term in the sum over u that changes is 
the one corresponding to u = Xt, and thus 

$(x m ,r t+ i) - $(x t ,r t ) = f(x t +i) - f(x t ) + [4>(x t ,r t+1 (x t )) - (f>(x t ,r t (x t ))} 

= f(x t+1 ) - f(x t ) + [/(x*) - /(4 n+l(a:t)) ) + A/(x f )] 
= A/fo), 

where we have used (jSJ) in the case when rt+i(zt) = 1. Therefore $(xt,r 4 ) — 
$(xo,r ) = Xl!=o A/(x s ). Also $(x ,r ) = /(x ), so we obtain 

t-i 

E A /(^) = - + E r 'H) - ^ r °w)] • ( 9 ) 
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In order to bound the last sum in Q, we use (JSJ) together with Lemma 
and the definition of to deduce 

d(u) 

\(f>(u,r t (u)) - ^(u,r («))| < - |/(«) " /(« ( °) + A /Hl 

i=i 

= ^d(«)p(«,t;)|/(«)-/(t;) + A/(«)| (10) 

(since d(u)p(u, v) is the number of z such that = v). We conclude by- 
applying the triangle inequality to (Q. □ 

Proof of Theorem^ We will apply Proposition [TBI with / = h^ c . Note that 
h(b) = 1 and h(c) = 0, while conditioning on the first step of the Markov 
chain gives h(u) = Ylvev p(u, v)h{y ) for u ^ b,c. Hence, using p(b,a) = 
P(c,a) = 1, 

{0, u^b,c; 
h(a) - 1, u = b; 
h(a), u = c, 

and thus Yf s =o Ah(x s ) = h(a)[n t (b) + n t {c)\ - n t (b). 

Turning to the other terms in Proposition[T3l note that \h(xt)—h(xo)\ < 1, 
and h(u) — h(v) + Ah{u) = when u e {b, c} and v — a. Substituting into 
Proposition [131 gives \h(a)[n t (b) + n t (c)] — n t (b)\ < K\ as required. □ 



Proof of Theorem^ We will apply Proposition [TBI with / = In this case 

Ak{u) 



-1, 

fc(a) u = b, 



and thus El=o Afc O S ) = K(i))(fc(fl)) + (t-nt(&))(-l) = (fc(a) + l)n t (6) -t. 
Substituting into Proposition [131 and using |/c(x t ) — k(x )\ < max„ e v k(v) 
and k(b) — k(a) + Ak(b) = completes the proof. □ 

To prove Theorem [3] we note some elementary facts about Markov chains. 

Lemma 15. Let b, c be two distinct vertices of an irreducible recurrent 
Markov chain, and let it be a stationary vector. Then 7r(6)e6 )C = 7r(c)e Cj &. 
Also the hitting probabilities h = hb iC satisfy Ah(b) = — e^c and Ah(c) = e c ^. 
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= p(c, 


a) 


= 1). 


0. 


u 


^ b,c 




u 


= b; 




u 


= c, 



Proof. Let A" denote the number of visits to c before the first return to b 
when started from b. It is a standard fact (see e.g. Theorem 1.7.6 in |20j) 
that EN = 7r(c)/7r(6). On the other hand F(N = n) = e 6)C (l - e c , b ) n - l e c , b for 
ra > 1, so EA" = e b:C /e C:b , and the first claim follows. For the remaining claims 
we compute Ah by conditioning on the first step: Ah{b) = (1 — e& ;C ) — = 
-e 6)C and A/i(c) = e Cib - /i(c) = e C)6 . □ 

Proof of Theorem We will again apply Proposition [13] with / = h = h^ c 
(now without the restriction p(b, a) 



Ah{u) 



and so Y^Z*o Ah(x s ) = —nt(b)e biC + n t (c)e c , b . In order to bound the terms in 
the last sum in Proposition [TBI in the cases u = b,c note that |A/i(tt)| < 1 in 
these cases, and so, for u = b,c, 

^2p(u,v)\h(u) - h(v) + Ah(u)\ < 1 + ^2p(u,v)\h(u) - h(v)\. 

Hence Proposition [13] gives 

\n t (b)e b>c - n t (c)e C:b \ < K 3 . 
Now divide through by n{b)e bfi (which equals 7r(c)e Ctb by Lemma [15]). □ 

Proof of Theorem^ We will apply Proposition [TBI with f = k = k b . Note 
that k{b) = 0, while E 6 T+ = 1 + *£ veV p(b, v)k{v). Also we have E fe T+ = 
1/tt(6) (see [2D]), hence 




ii = 6. 



We bound the term for u = b in Proposition [TBI thus: ^2 vGV p{b,v)\k(b) 
k(v) + Ak(b)\ < l/n(b) + ^2 veV p(b,v)\k(b) - k(v) - 1\. We obtain 



n t {b) 



< K. 



n{b) 

and multiply by 7t(b)/t to conclude. □ 
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3 Proofs for walks on Z 2 



Our proof of Theorem [5] is based on the two lemmas below. For k > 1 
we define the fcth box B(k) := (— k, k] 2 D Z 2 and the fcth layer dB{k) := 
B(k)\B(k-l). See Figure El 

Lemma 16. Fix two distinct vertices b,c of 7?, and let h = hb >c be the 
hitting probability for the simple random walk on the square lattice. There 
exists C — C(6, c) G (0, oo) such that for all positive integers k, 

\h(u)-h(v)\<C\nk. 

u,v*EB(k): 
\\u—v\\i =1 

Proof. Fix b, c and write C±, C2, ■ ■ ■ for constants depending on b, c. We claim 
first that for all wGZ 2 , 

h(v) = d + e bjC [a(v - c) - a(v - &)], (11) 

where a : 1? — > M is the potential kernel of Z 2 . (The function a may be 
expressed as a(v) := lim.n_s.oo __t_oP^(-^* = 0) — ^(X t = v )], where is the 
simple random walk on Z 2 — for more information see e.g. [231 Ch. 3] or [T5l 
Sect. 1.6].) To check (jlip . we note the following facts about a. Firstly, 

a(v) = A + I \n\v\ +0(\v\- 2 ) as \v | 00, (12) 

where \v\ := ||u H2 and A is an absolute constant (see [TSl p. 39]). Since 
4- (A + - lax) = -x~ l we deduce 

|a(u — c) — a(f — 6)| < C 2 |u| _1 . 

Secondly, writing A for the Laplacian of the random walk on Z 2 , i.e. A/(tt) := 
I Y, v .\\ u -vh=i f( v ) ~ we have 

Aa(v) = l[v = 0]. 

Hence, using Lemma [15] and the fact that 7r = 1 is a stationary vector for 
the random walk, the function v 1— >■ — e6 )C [a(w — c) — a(u — 6)] is bounded 
and harmonic, therefore constant, establishing (II ip . 
We now claim that for all u, v with \\u — v ||i = 1, 

< c 3 |t'r 2 . (13) 
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Once this is established we obtain 

k 

\h(u)-h(v)\<J2C,j(C 3 j- 2 )<Clnk. 

u,v<=B(k): j=l 
\\u—v\\i=l 

as required. 

Finally, turning to the proof of ( !T3|) . combining (ITT1) and (fT2|) gives 

h{u) — h(v) = C^ln \u — c\ — In \u — b\ — In \v — c\ + In \v — b\) + 0(|v|~ 2 ). 

In order to bound the above expression, fix u — v to be one of the 4 possible 
integer unit vectors, and write v — c = z and c — b = a and u — v — /3. For 
convenience identify the vector (x, y) with the complex number x + iy and 
let | • | denote the modulus. We have 

In \u — c\ — In \u — b\ — In \v — c\ + In \v — b\ 

= ]n (z + a)(z + P) 
(z + a + j3)z 

=0(\z\' 2 ) as z -> oo. □ 

Fix a,i),c6Z 2 , and consider the rotor walk xq, Xi, . . . started at a with 
rotor mechanism (J3J) and rotor configuration (jSJ) modified so that p(b, a) = 
p(c, a) = 1 as discussed in the paragraph preceding the statement of Theorem 
We say that the walk enters a new layer at time t if for some k we have 
xo, ■ ■ ■ , xt-i G B{k) but Xt £ B{k). 

Lemma 17. Under the above assumptions, between any two times at which 
the rotor walk enters a new layer, it must visit vertex a at least once. Also, 
between any two consecutive visits to vertex a, no vertex is visited more than 
4 times. 

Proof. We start by proving the first assertion. The reader may find it helpful 
to consult Figure [2] throughout. Suppose for a contradiction that a G B{k — 
1), and that the rotor walk enters both the layers dB(k) and dB(k + 1) for 
the first time without visiting a in between. Let s be the time of the last visit 
to a prior to entering dB(k), and let t be the first time at which dB(k + 1) 
is entered. 

We claim that some vertex v emitted the particle at least 5 times during 
[s,t]. To prove this, note first that Xt-i G dB(k), and consider the following 



In 



a (3 
1 + - + - 

z z 



a 

z 







+ 0(\z\- 2 ) 
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two cases. If x t -i is not one of the four "corner vertices" of dB(k), then 
immediately after the particle moves from x t -\ to x t G dB{k + 1), the rotor 
at Xt-i is pointing in the same direction as in the initial rotor configuration 
r. Since this rotor did not move before time s, vertex art— 1 must have emitted 
the particle at least 4 times during [s,t]. Therefore, Xt-i must have received 
the particle at least 4 times from among its 4 neighbors in [s, t] - but it 
has not received the particle from x t , therefore by the pigeonhole principle 
it received it at least twice from some other neighbor v. And v ^ {b, c} 
since x t -i ^ a. By considering the rotor at v, we see that this implies that 
v emitted the particle at least 5 times during [s,t]. On the other hand, if 
Xt-\ is a corner vertex of dB(k), then on comparing with the initial rotor 
configuration r we see that x t -\ has emitted (and hence received) the particle 
3 or 4 times, but two of its neighbors lie in dB(k + 1), so it did not receive 
the particle from them, and the same argument now applies. Thus we have 
proved the above claim. 

Now let u be the first vertex to emit the particle 5 times during [s, t]. Then 
u {a,b,c}, otherwise we would have a contradiction to our assumption 
that a is visited only once. But now repeating the argument above, u must 
have received the particle 5 times, so it must have received it at least twice 
from some neighbor, not in {a, b, c}, so this neighbor must have emitted the 
particle 5 times by some earlier time in [s,t], a contradiction. Thus the first 
assertion is established. 

The second assertion follows by an almost identical argument: if some 
vertex is visited at least 5 times between visits to a, then considering the 
first vertex to be so visited leads to a contradiction. □ 

Proof of Theorem^ We write C\, C2, ... for constants which may depend on 
a, b, c. We use the proof of Proposition [13] in the case f — h. As in the proof 
of Theorem [fl equation §§§ becomes 

h(a)n - n t (b) = h(x t ) - h(a) + ^ [<K M ' r t{u)) - (f)(u,r (u))] , 

u£V\{b,c} 

where n = n t := n t {b) +n t (c). However, the term <f>(u,r t (u)) — (f)(u,r (u)) is 
non-zero only for those vertices which have been visited by time t. Now the 
first assertion of Lemma [T71 implies that at most one new layer is entered for 
each visit to a, and thus for each visit to {b, c}. Hence for some Ci, all the 
vertices visited by time t lie in B(n + C\) (where the constant C\ depends 
on the layer of the initial vertex a) . 



22 



Now proceeding as in the proof of Proposition [T3] and using Lemma dHl 



W«,r*(«))-^(«,r («))]|<| Yl \Ku)-h(v)\ 

ueB(n+d)\{b,c} u,v£B(n+Ci+l): 

\\u—v\\i =1 

< Chin. 

Combining this with the above facts gives 

\h(a)n — nt(b) | < 1 + C In n, 

as required. 

Finally to prove the bound t < C'n 3 , we note by the second assertion of 
Lemma [T7] that after n visits to vertex a, each of the at most C^n 2 vertices 
in B(n + C\) has been visited at most 4n times, so the total number of time 
steps is at most 4C 2 n 3 . □ 



4 Proofs for transfinite walks 

Proof of Lemma By irreducibility it is enough to show that if u is visited 
infinitely often and p(u, v) > then v is visited infinitely often. But this is 
immediate since v = u^' for some i, so the rotor at u will be incremented to 
point to v infinitely often. □ 

Proof of Lemma As in the preceding proof, if u is visited infinitely often 
and p(u, v) > then v is visited infinitely often, proving the first assertion. 
For the second assertion, let M be one greater than the first m for which the 
walk x mui , x mui+ i, ... is recurrent, or M = uj if all are transient. Then a is 
visited infinitely often before time Mw, and we apply the first assertion. □ 

Proof of Theorem [3 We consider the quantity $ defined in the proof of 
Proposition [131 with f = h = h b)C (as in the proof of Theorem [Q. Sup- 
pose Xq, Xi, . . . is a transient rotor walk. We claim that 

®(x u , r u ) - lim r t ) = h(a). (14) 

t— >oo 

The claim is proved as follows. The assumption of the theorem and the fact 
that the walk is transient imply that lim^oo h(x t ) = 0. We clearly have 
lim^oo <j)(u, r t (u)) = (^{u^r^iu)) for each u, and by ( TTUj) and the definition 
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of K\ in Theorem [T] we have for all u and t that \(f)(u,r t (u)) — <f)(u,r (u))\ < 
F(u) where Yluev ^( u ) — — 1)- Hence by the dominated convergence 
theorem, 

lim $(x t ,r t ) = + \(f)(u,r u (u)) - <p(u,r (u))] = ${x u ,r u ) - h{a). 

u€V 

We have proved claim (1T41) ; thus whenever we "restart from infinity to a", 
the quantity $ increases by /i(a). Combining this with the argument from 
the proof of Theorem [TJ we get 

[n T (b) + n T (c) + m] a(a) - n T (b) = $(x r , r r ) - $(x , r ) 

for r = muj + 1, and the right side is bounded in absolute value by K\ exactly 
as in the proof of Theorem [TJ □ 

Proof of Theorem We consider the quantity $ defined in the proof of 
Proposition [T3J with / = g — g b . Note that 

y ' [-1, u = b. 
Mimicking the proof of Theorem [8], we obtain 

g(a)m - n T (b) = $(x r , r T ) - $(x , r ), 

and we bound the right side as in the previous proofs, noting that when u = b 
we have \g(u) — g{v) + Ag(u)\ < \g{u) — g(v) \ + 1. □ 

Our proof of Theorem [10] is based on an unpublished argument of Oded 
Schramm (although we present the details in a somewhat different way). We 
will need some preparation. It will be convenient to work with R n := n — I n , 
i.e. the number of times the transfinite rotor walk returns to a without going 
to infinity up to the time of the nth return to a. We also introduce some 
modified Markov chains and rotor mechanisms as follows. 

Firstly, replace the vertex a with two vertices ao and a%. Let V = 
(V \ {a}) U {a ,a>i} denote this modified vertex set. Introduce a modified 
transition kernel p by letting ao inherit all the outgoing transition probabili- 
ties from a, and letting a\ inherit all the incoming transition probabilities to 
a (i.e. let p(ao, v) = p(a, v) and p(v, a\) = p(v, a) for all v G V \ {a}); also let 
p(ai, ao) = 1 and p(a,Q, ai) = 0, and let p otherwise agree with p. 
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Secondly, for a positive integer d, let B(d) denote the set of vertices that 
can be reached in at most d steps of the original Markov chain starting 
from a, and let dB(d) := B(d) \ B(d — 1). Let jr be p modified so that 
^(b, ao) = 1 for all b G dB(d). (Thus, on reaching distance d from a, the 
particle is immediately returned to ao). 

Fix a rotor mechanism and initial rotor configuration for the original 
Markov chain, and modify them accordingly to obtain a rotor walk associated 
with jr, started at ao- Let be the number of times this rotor walk hits ai 
before the nth return to a (i.e. before the (n + l)st visit to a ). Also note 
that R n is the number of times the transfinite rotor walk associated with p 
and started at ao hits a\ before the nth return to ao- 

Lemma 18. For a fixed initial rotor configuration, and any non-negative 
integer n, we have — > R n as d — > oo (i.e., R% = R n for d sufficiently 
large). 

Proof. For v G V, let N%(v) (respectively N n (v)) be the number of visits to 
vertex v before the nth return to ao for the (transfinite) rotor walk associated 
with p 1 (respectively p). We claim that 

N*->N n as d oo, (15) 

where the convergence is in the product topology on N v ; in other words, for 
any finite set F C V, if d is sufficiently large then N%(v) = N n (v) for all v G 
F. The required result follows immediately from this, because R* = N%(ai) 
and R n = N n (ai). 

We prove (I15p by induction on n. It holds trivially for n = because 
A^q and N equal zero everywhere. Assume it holds for n — 1. This implies 
in particular that the rotor configuration at the time of the (n — l)st return 
to ao similarly converges as d — > oo to the corresponding rotor configuration 
in the transfinite case. Now consider the portion of the transfinite rotor 
walk corresponding to p, starting just after the (n — l)st return to ao, up 
until the nth return to ao- Consider the following two possibilities. If this 
walk is recurrent (so that it returns to ao via a\) then it visits only finitely 
many vertices, so if d is sufficiently large that A 7 "^_ 1 and N n _\ agree on all the 
vertices it visits, then N% and N n agree also agree on the same set of vertices, 
establishing (1151) in this case. On the other hand, suppose the aforementioned 
walk is transient (so that it goes to infinity before being restarted at ao). 
Given a finite set F <Z V, let d be such that that when this walk leaves F for 



25 



the last time, it has never been outside B(d). Now let d! be such that N^'^ 
and N n _i agree on B(d). Then N% and N n will agree on F. So (fT5|) holds in 
this case also, and the induction is complete. □ 

Lemma 19. For all positive integers n and d we have R^ 1 > Re- 
proof. This will follow by a special case of the Abelian property for rotor 
walks on finite graphs with a sink (see e.g. [T2J Lemma 3.9]). First we slightly 
modify the mechanism yet again. Consider the rotor mechanism and initial 
rotor configuration corresponding to p rf+1 . Remove all the vertices in V \ 
B(d + 1) (these cannot be visited by the rotor walk started at ao anyway). 
Introduce an additional absorbing vertex s (called the sink), and modify the 
transition probabilities so that on hitting a± or dB(d +1), particles are sent 
immediately to s instead of to ao- Modify the rotor mechanism accordingly, 
but do not otherwise modify the initial rotor configuration. 

We now consider the following multi-particle rotor walk (see e.g. [12] 
or the discussion in the introduction for more information). Start with n 
particles at a , and perform a sequence of rotor steps. That is, at each step, 
choose any non-sink vertex which has a positive number of particles (if such 
exists), and fire the vertex; i.e. increment its rotor, and move one particle 
in the new rotor direction. Continue in this way until all particles are at the 
sink. [T2l Lemma 3.9] states that the total number of times any given vertex 
fires during this procedure is independent of our choices of which vertex to 
fire. 

In particular, consider the firing order in which we first move one particle 
repeatedly (so it performs an ordinary rotor walk) until it reaches s, then 
move the second particle in the same way, and so on. Thus the number of 
times di fires is R^ 1 - Alternatively, we may move one particle until the first 
time it reaches dB(d) U {s}, then "freeze" it, and move the second particle 
until it reaches dB(d) U {s}, and so on. At this stage, the number of times 
a\ has fired is R%. Now we can continue firing until the frozen particles reach 
s. Comparing the two procedures shows Rn +1 > Rt- D 

Corollary 20. For all positive integers n and d we have R n > R^. 

Proof. Immediate from Lemmas fT8l and [T9l □ 

Proof of Theorem\TQ Since R n = n — I n , the required result is clearly equiv- 
alent to liminfn^oo R n /n > F a (T+ < oo). Fix any e > 0. Then there exists 
d such that P a (^' a f < Tg B ^) > F a (T+ < oo) — e. Now consider the modified 
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rotor walk corresponding to fr as defined above. Since the set of vertices 
that can be reached from ao is finite (so in effect the vertex set is finite), 
Theorem [1] implies that R^/n —> ^a(T+ < Tqb{(1)) as n — > oo. Putting these 
facts together with Corollary [20] we obtain 

liminf ^ > lim ^ = P a (T+ < T 9B{d) ) > P a (T+ < oo) - e. □ 



5 Proofs for stack walks 

In this section we will prove Proposition [111 an d use it together with Propo- 
sition [21] below to prove Theorem [12] Given a Markov chain and a stack 
mechanism, we define the discrepancy functions 

D n (u, v) := #{z < n : u^' — v } — np(u, v). 

Proposition 21. For any Markov chain, any stack walk, any function f and 
any t, 

t-i 

A/(x s ) = f(x t ) - f(x ) + D n t (u)(u, v) [/(«) - f(v) + A/0)] . 
s=o u,vev 

Proof. Consider the function 

ueV 

where 

n 

tf(u,n) :=£[/(u)-/(u«) + A/(u)]. 

i=l 

As in the proof of Proposition [131 we have ^f(x s ) = &(t) — \I> (0) . 

From the definition of D we have 

V>(«, n) = [ £> «( u > w ) + n ^( u ' [/(«) - /(«) + A /H] • 

But by the definition of the Laplacian, ^2 v&v p(u,v)[f(u) — f(v)+Af(u)] = 0; 
therefore 

n) = J] A>(«, u) [/(«) - /(«) + A/H] , 

t)6V 

and the result follows on substituting. □ 
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Proof of Proposition \T]\ First note that it suffices to prove the case in which 
Pi, . . . ,p n are all rational. The irrational case then follows by a limiting ar- 
gument. Specifically, let p\, . . . ,p% be rational with p\ — \ pi as k — >■ oo, and 
let Zi, z\ , . . . be a sequence satisfying (JSJ) for the pf's; then by a compact- 
ness argument (since {1, . . . ,n} is finite) there is a subsequence (kj) and a 
sequence z\, z 2 ■ ■ ■ such that z t 3 — > z t for each t, and (z t ) then satisfies (jSJ) for 
the PiS. 

Now suppose that pi, . . . ,p n are rational, and let d be their least common 
denominator. Consider the finite bipartite graph G with vertex classes L : = 
{1, . . . , d} and R := [J™ =1 Ri where Ri := {(z, m) : m G {1, . . . and 
with an edge from t G L to (z, m) G i? if and only if 



"m — 1" 




"m" 




< * < 




Pi 




Pi 



(16) 



We will prove that G has a perfect matching between L and i?. Note 
first that #L = d = YliVid — ir~R- We claim that any set T C L has 
at least Pij^T neighbors in Rf, from this it follows that it has at least j^T 
neighbors in R, and the existence of a perfect matching then follows from 
Hall's marriage theorem. To prove the claim, fix % G {1, . . . ,n} and note 
that ( IT6|) is equivalent to p^t — Pi < m < p{t + 1. Therefore in the case 
when T is an interval [s,i], it is adjacent to all those pairs (i,m) G Ri for 
which m is an integer in (piS —pi,Pit + 1] H [1, d]; this includes all integers in 
(jPiS — Pi, Pit + 1) (since — > and pjt + 1 < d + 1). The latter interval 
has length pi(t — s + 1) + 1, therefore it contains at least pi(t — s + 1) = Pij^T 
integers as required. Now consider the case T = [s, t]U[u, v] (where u > t+1). 
If the two intervals have disjoint neighborhoods in R4, the claim follows by 
applying the single- interval case to each and summing. On the other hand 
if the neighborhoods of the two intervals intersect, we see from (fT5"|) that the 
neighborhood in Ri of T is the same as the neighborhood in Ri of the larger 
set [s,v], so the claim again follows from the single-interval case. Finally, 
the case when T is a union of three or more intervals is handled by applying 
the same reasoning to each adjacent pair, proving the claim and hence the 
existence of a matching. 

Fix a perfect matching of G, and for t = 1, . . . , d, let Zt '■— i where Ri 
contains the partner of t. It follows from f|T6|) that if (i, m) and (i, m+1) have 
respective partners t and if then t < t'. Therefore t and (i, m) are partners 
if and only if z t is the mth occurrence of i in the sequence z; from f|T6|l this 
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mth occurrence appears between positions and \— ] . Thus, 

iMl < #{s < t : z s = 1} < [ Pi t\ + 1, 

and it follows that ((6]) holds for all t < d. Note also that the left side of ((6]) is 
zero for t = d, therefore continuing the sequence z so as to be periodic with 
period d completes the proof. □ 

(For an alternative proof of Proposition [TT] that applies also to infinite 
probability vectors, see [2].) 

Proof of Theorem UM Choosing the stack mechanism according to Proposi- 
tion [TT] ensures that \D n (u,v)\ < 1 for all u, v and n. Now apply Proposi- 
tion |2TJ to / = h to obtain 

\h(a)[n t (b) + n t {c)\ - n t (b)\ 

< \h(x t ) - h(x )\ + ^ \ D n t (u)(u,v)\ ■ \h(u) - h(v)\, 
uev\{b,c}, 

v€V 

and conclude by noting that D nt ( u )(u,v) = unless p(u, v) > 0. □ 

Open questions 

As the burgeoning literature on Eulerian walk and rotor-routing attests, there 
are numerous interesting open problems. Here we focus on a few that are 
related to rotor walk on Euclidean lattices. 

(i) Can the bound C log n/n in Theorem [5] for the discrepancy in hitting 
probabilities for simple random walk on Z 2 be improved to C/n? Do 
similar results hold in Z d and for other initial rotor configurations? 

(ii) For simple random walk on Z 2 , let all rotors initially point East, and 
consider the transfinite rotor walk restarted at the origin after each 
escape to infinity. What is the asymptotic behavior of I n , the number 
of escapes to infinity before the nth return to the origin? Theorem [10] 
implies that I n /n — > as n — > oo, but simulations suggest that the 
convergence is rather slow. 

(iii) For simple random walk on Z d with d > 3, does there exist an initial 
rotor configuration for which the rotor walk is recurrent? 
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